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The aim of this paper it to estabhsh sufficient conditions for consistency of moving block boot- 
strap for non- stationary time series with periodic and almost periodic structure. The parameter 
of the study is the mean value of the expectation function. Consistency holds in quite general 
situations: if all joint distributions of the series are periodic, then it suffices to assume the cen- 
tral limit theorem and strong mixing property, together with summability of the autocovariance 
function. In the case where the mean function is almost periodic, we additionally need uniform 
boundedness of the fourth moments of the root statistics. It is shown that these theoretical 
results can be applied in statistical inference concerning the Fourier coefficients of periodically 
(PC) and almost periodically (APC) correlated time series. A simulation example shows how to 
use a graphical diagnostic test for significant frequencies and stationarity within these classes of 
time series. 
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1. Introduction 

Moving block bootstrap (MBB) , introduced by Kiinsch [18] and Liu and Singh [22] , is a 
nonparametric bootstrap procedure that can be applied to dependent observations, that 
is, time scries. It consists of calculating the estimator over replicated series obtained by 
drawing with replacement from the blocks of consecutive data. By means of this resam- 
pling procedure, we obtain approximations of unknown distributions of root statistics. 
Then, on the basis of these approximations, we may construct confidence intervals and 
test different practical problems. It seems that the MBB procedure is quite well investi- 
gated in the case of strictly stationary strong mixing time scries (see, e.g., Kiinsch [18], 
Radulovic [25] and Lahiri [20]) and sufficient conditions for consistency were formulated 
under quite general conditions for this set-up. As for the non-stationary case, some results 
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have recently been obtained. Fitzenberger [9] and Politis et al. [24] give conditions for 
MBB consistency for the univariate mean without stationarity assumption, whereas the 
results of Lahiri [19] and Gonqalves and White [13] concern the general heterogeneous 
time series. 

In this paper, wc concentrate on a special case of non-stationarity, that is. periodic and 
almost periodic time scries. We develop techniques, presented in Arconcs and Ginc [2] and 
Radulovic [25], that arc based on a general central limit theorem (CLT) for infinitesimal 
arrays (Araujo and Gine [1]). Our parameter of interest will be the mean value of non- 
constant, almost periodic mean function EXt, and it is estimated by the estimator Xn = 
(1/n) '^t=i -^t- Having results concerning this parameter, we can derive results regarding 
higher-order moments or corresponding Fourier coefRcients (see Section 4) . Let us argue 
that the results concerning the univariate mean do not apply here; neither do Theorems 
2.2 and 2.1 from Goncalves and White [13], in which it is required that the time series 
satisfy the following condition: 



and this docs not tend to zero if the expectation is a non-constant, almost periodic 
function (see Lemma A.l in the Appendix). Finally, the results of Lahiri [19] are very 
restrictive. 

Chan et al. [5] and Politis [23] found modifications of the MBB procedure that are 
applicable to some specific time series with periodic structure. Unfortunately, their pro- 
cedures require that we know the exact length of the period. Therefore, we cannot use 
them in the problem of determining significant frequencies. Moreover, these procedures 
do not generalize to the almost periodic case. Moving block bootstrap itself does not 
have these restrictions: we do not have to know the period and the procedure can also 
be easily performed in the almost periodic case. 

Statistical inference in the aforementioned special case of non-stationarity is of great 
practical importance. Many time series data in economics, telecommunications or clima- 
tology possess such structure. For examples, we refer the reader to Gardner el al. [10] 
and references therein. Let us add that if wc have a series with periodic mean, the period 
can usually be easily guessed from the plot of the series and we may extract seasonal 
means to obtain zero-mean time series. However, this cannot be done for higher-order 
periodicity. Moreover, in the almost periodic case, wc arc usually unable to extract the 
mean, which is an almost periodic function. The only solution is to estimate the Fourier 
coefficients and in order to do this, the significant frequencies should be known. As will 
be shown in Section 4, the MBB procedure is of considerable help in detecting these 
significant frequencies. 








for n 



oo. 
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Section 2 of this paper includes formal definitions of the time series classes that are 
under consideration. Section 3 presents a description of the MBB algorithm and new 
results regarding its consistency for strictly periodic and then for almost periodic struc- 
tured time series. The next section contains the application of MBB in the detection 
of the significant frequencies for second-order periodically (PC) and almost periodically 
(APC) correlated time scries. All proofs are deferred to the Appendix. 

2. Classes of time series to be considered 

To begin, we give definitions of the time series classes that will be studied in this paper. 
The order parameter r and the length of the period T are assumed to be positive integers. 

Definition 2.1. The time series {Xt : < S Z} is called strictly periodic of order r (SP(r)) 
with period T if, for any ti , T2 , . . . , r^-i G 

Definition 2.2. The time series {Xi -.t eZ,} is called strictly periodic (SP) with period 
T if it is SP (r) with period T for any r G N. 

A large class of SP models are time series of the form (Synowiccki [27]) 

Xt^FiZtJit)), 

where the time series {Zt} is strictly stationary, the function /(•) is periodic and the 
function F(-,/(t)) is measurable for any t E'Z. 

Definition 2.3. The time series {Xt :t €Z} is called weakly periodic of order r (WP(r)) 
with period T if E\Xt\^ < oo and, for any t,Ti,T2, . . . ,Tr-i G Z, 

Before we introduce another definition, wc will briefly recall the concept of almost 
periodic functions. A real- or complex-valued function / is called almost periodic if for 
every e > 0, there exists a number l^ such that for any interval of length greater than Z^, 
there exists a number pe in this interval such that 

sup|/(i-fp,)-/(t)|<e 

(see Corduneanu [6]). Almost periodic fimctions generalize periodic functions. They pos- 
sess similar properties, such as boundedncss and Fourier representation. As an example, 
consider the following function: 

/(0=cos(Ai). 
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If t £ R, this function is periodic with period T = 2n/X. However, if i S Z and A 7^ 2n/m, 
where m G Z, the function / is not periodic, but is almost periodic. The foUowing fact 
characterizes almost periodic sequences (Corduneanu [6]): the sequence {a„} is almost 
periodic if and only if there exists an almost periodic function / defined on R such that 
/(n) = a„ for all n € N. The space of almost periodic functions is closed with respect to 
products, sums and uniform limits. Moreover, for any function / belonging to this class, 
its mean value, that is, the quantity 



M,(/(t))= hm - fU), 



exists, uniformly with respect to the number s. The subscript t in the symbol Mt is 
included to emphasize the averaging over the variable t. 

The next important fact regarding almost periodic functions is that the set 

A/ = {Ae[0,27r):M,(/(t)c-'^*)^0} 

is countable. If, beyond this, the set is finite, then the function / has some further 
desired properties. First, there exists a finite constant C, independent of s and n, such 
that 



,s+ri— 1 

- f{t)-Mt{f{t)) 



t=s 



<-, (1) 

n 



which is implied by the discrete counterpart of Lemma 2 from Cambanis et al. [4] . Second, 
the Fourier representation becomes equality (Corduneanu [6]), that is, 

xeAf 

This identity is very important in statistical inference of the time series defined below. 
Note that for a purely periodic function with period T, we have 

A/c|^:fc = 0,...,T-l 

so this set is always finite. In contradistinction, when the set A/ is not finite, then it 
must contain cluster points. Such a situation causes trouble in statistical reasoning (see, 
e.g., Hurd [14] and Dchay and Leskow [7]). 



Definition 2.4- The time series {Xt :t € Z} is called weakly almost periodic of order 
r (WAP(r)) ifE\Xt\^<oo and, for any i, ti, T2, . . . , t,._i G Z, the function 

is almost periodic in the variable t. 
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As an example, we could consider amplitude-modulated series of the form Xt = f(t)Zt, 
which are WAP(r) provided that the series {Zt :t ^I^} is WP(r) and the function / is 
almost periodic. 

It is easy to see that WP(r) C WAP(r) and, for any two positive integers such that 
ri < r2, we have that SP(ri) C SP(r2) C SP. Moreover, each weak periodicity is imphed 
by the corresponding strict periodicity, provided that the appropriate moments exist. 
Let us add that the class of series that are both WP(1) and WP(2) is identical to the 
class of periodically correlated (PC) time series in the sense of Gladyshev [12]. A series 
that is both WAP(l) and WAP(2) is almost periodically correlated (APC) in the sense 
of Hurd [14]. For statistical inference within these classes, we refer the reader to Hurd 
and Leskow [15] and Dehay and Leskow [7]. 

3. Results regarding MBB for time series with 
periodic and almost periodic structure 

Our aim is to investigate the mean value /i = Mt{EXt) of the real- valued time series 
{Xt -.t gZ} that is (almost) periodic in the first or higher order. The standard estimator 
obtained from the sample {Xi, . . . , X„) is of the form X„ = (1/n) X]"=i -^t- We wish to 
determine sufficient conditions for the moving block bootstrap which would enable us to 
calculate approximations of the quantilcs without using the form of asymptotic variance. 
In order to present the MBB procedure, let us denote the block of 6 = b{n) consecutive 
observations as Bt^b = {Xt, . . . ,Xt+b-i) and k = k{n) = n/bin) which, without loss of 
generality, is assumed to be integer-valued throughout the whole paper. Let ii,Z2, . . . ,ifc 
be i.i.d. random variables with uniform distribution on the set {1, 2, . . . , n — + 1}. By 
joining the blocks Bi^_b, ■ ■ ■ , Bi^^b, we obtain the MBB sample {X'(, . . . , X*) and the MBB 
version of the estimator takes the form X* = {^/n)J2t=i-^t- following, the P* , 

E* and Var* denote quantities obtained from replicated series conditioned on the sample 
{Xi, . . . ,X„). The asymptotic variance is always assumed to be positive. 

Theorem 3.1. Let {Xt :t G Z} be a strictly periodic with period T, a-mixing time series 
and let X^ be generated by the MBB procedure with b = o{n) but 5 — > oo. Assume that: 

(i) the autocovariance function is summable, that is, 

oo 

Y,\C0v{Xt,Xt+r)\<OO 

T=0 

for all t ^ \, . . . ,T ; 

(ii) the CLT holds, that is, 

V^(X„-//)^AA(0,(t2), (2) 



where fi ~ Mt (EXt ) . 
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Then, MBB is consistent, that is. 



sup |P( V^(X„ -n)<x)-P* iV^{Xl -E*xl)<x)\'^0. 



(3) 



We can say that the above theorem is a generaUzation of Theorem 2 of Radulovic 
[25] from the case of strictly stationary to non-stationary strictly periodic time series. 
We assume periodic structure of all joint distributions and no rate of convergence of 
a-mixing function. 

Corollary 3.1. Let {Xt : i G Z} be a strictly periodic with period T, a-mixing time series 
and let X^ be generated by the MBB procedure with b = o{n), but b —t oo. Assume that 
for some 5 > Q: 



Then, CLT (2) holds and the MBB procedure is consistent, in the sense of (3). 

The next step will be to formulate a general theorem regarding consistency of moving 
block bootstrap for non-stationary time series with almost periodic mean. 

Theorem 3.2. Let {Xt : t £ Z} be an APC, a-mixing time series and let X^* be generated 
by the MBB procedure with b = o{n), but 6 — > oo. Assume that: 

(i) the set A = {A e [0, 27t) : Mt{EXte-'^*) ^ 0} is finite; 

(ii) the autocovariance function is uniformly summable, that is, \ Cov(Xj, Xt^T) \ < c^, 
where the sequence {c,-}!^g is summable; 

(iii) there exists a finite constant K that does not depend on b = b(n) < n and n, such 
that 



(i) E\Xt\^+^ <^ fort^l,...,T; 

/■■\ S/(2+S)/ N 

(u) Er=i"x '(r) <oo. 





(iv) the CLT holds, that is. 



V^{x, 



n 



M)^AA(0,a2), 



(5) 



where /i = Mt [EXt ) . 



Then, the MBB is consistent, that is. 



sup \P{^/n{Xn — /i) < x) 



p*(V^(<-i?*<)<x)|^o. 



(6) 
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We will now describe two specific situations in which Theorem 3.2 is satisfied. As- 
sumptions (ii) and (iii) can be guaranteed by an appropriate mixing rate and uniform 
boundedness of moments of the series. 

Corollary 3.2. Let {Xf : t e Z} be an APC, a-mixing time series and let be generated 
by the MBB procedure with b = o{n), but 6 — s- oo. Assume that: 

(i) the set A = {A e [0, 27r) : MtiEXtC-'^*) ^ 0} is finite; 

(ii) sup^^^ E\Xt\^^^ < oo for some S > 0; 

(iii) j:T=iraf'+'\r)<^; 

(iv) the CLT holds (i.e., (5) is satisfied). 

Then, the MBB procedure is consistent, in the sense of (6). 

First, note that (5) can be obtained by, for example, Theorem B.0.1 of Pohtis et al. 
[24]. We can easily verify its condition (B.2) by means of Lemma A. 6. A slightly stronger 
mixing rate should be assumed, that is. 



E 

T=0 



/ , in2 (2+5)/(10+<5) / ^ ^ 

(t + 1) a-^ '[t) < oo. 



where the parameter S is defined in Corollary 3.2. Second, we can take a constant expec- 
tation function and the series for which, instead of WAP (2) assumption. 



1 \ 2 



s=l 



sup Var 2, \ ^ a for 

....n-6+l Wb / 



Then, Corollary 3.2 can be viewed as a generalization of Theorem 4.4.2 (the univariate 
mean case) from Politis et al. [24] since the assumption regarding the mixing rate is 
weaker. 

The last result of this section concerns uniformly bounded time series. 

Corollary 3.3. Let {Xt : t G Z} be an APC, a-mixing time series and let X^ be generated 
by the MBB procedure with b = o{n), but 6 — > oo. Assume that: 

(i) the set A = {A e [0, 2n) : MtiEXtC'^*) ^ 0} is finite; 

(ii) the series {Xt} is a.s. uniformly bounded; 

(iii) ax(T)=0(r-2); 

(iii) the CLT holds (i.e., (5) is satisfied). 

Then the MBB procedure is consistent, in the sense of (6). 



Therefore, in the case of uniformly bounded random variables, further relaxation re- 
garding the mixing rate can be allowed. 



1158 



R. Synowiecki 



4. Application to the Fourier coefficients of the 
autocovariance function 

In the case of periodically (PC) and almost periodically (APC) correlated time series, 
statistical inference focuses mainly on second-order properties of the series. If no assump- 
tion regarding the APC model is made, it is based on the Fourier representation of the 
function B{t,T) = E^XtXt+r) (Hurd and Leskow [15], Dehay and Leskow [7]), that is 

B(t,T)^ a(A,r)c'^*. 

We let 

and the set At- = {A:a(A,r) ^ 0} is assumed to be finite. In the engineering literature, 
a(A, t) is called a cyclic autocorrelation function, while the elements of the set A,- are 
called cyclic frequencies. 

If we observe the real- valued series {Xt : t G Z} ior t ~ 1, . . . ,n, the estimator of the 
parameter a(A, r) is of the form 

n— max{r,0} 

a„(A,T) = — y XtXt+re-'^'. 

' ' t=l-'min{r,0} 

Its properties, such as strong consistency and asymptotic normality, were studied for the 
case of (y9-mixing stochastic processes in Hurd and Leskow [15] and Dehay and Leskow [7]. 
Recently, these results have been generalized to the case of a-mixing APC time series 
(Leskow and Synowiecki [21]). The aforementioned sufficient conditions for the CLT for 
the estimator d„(A,r) require the mixing rate 

oo 

provided that supj £'|At|^+^'' < oo and that the series is also WAP (4). Unfortunately, 
the form of asymptotic variance is quite complicated and depends on fourth-order mean 
values, so it is not applicable in practice. This justifies why it is important to develop 
resampling methods such as MBB within the class of PC and APC time series. 

Remark 4-1- Without loss of generality, assume that r > 0. For the APC time series 
{Xt :t gZ}, define the time series 



Wt{X,T)^XtXt+re-'- 
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Its expectation function is almost periodic and, in fact, for all A € [0,27t), apart from at 
most a finite number of them, not purely periodic. It is easy to see that 

1 " 

Mt{EWt{X,T)) ^ lim - Vs(Xt+,Xte-'^*)=a(A,r) 

and 

^ n—r 

Wn-A^ r) = y,Wt = a„(A, r). 



Therefore, it will be possible of use the results regarding MBB for the expectation 
function of the estimator a„(A,r). Let (W^^* (A, r), . . . , W^_^(A, r)) be an MBB sample 
obtained from the sample 

(1^1 (A, r), . . . , (A, r)) = (XiXi+,e-'\ . . . , X„_,X„e-'^("-^)). 

The MBB version of the estimator a„(A,T) is defined as 



n—T 

; ( A, r) = ( A, r ) = ^ ^ ^t* ^) 



n — T 



We now provide a theorem regarding the consistency of the MBB estimator a*(A,T). 
The inequalities between complex numbers involving a(A,T), a„(A,T) and (x^y) are to 
be understood componentwise. 

Theorem 4.1. Let {X^ii G Z} be an APC and WAP(4) time series that satisfies the 
following conditions: 

(i) the set {A e [0, 27t) : Mt{B{t, r)c"'^*) ^ 0} is finite; 

(ii) sup,g^i?|A,|8+2*<oo; 

(ill) Lfc=i™x (^) <oo.' 

(iv) i/ie CLT for the estimator an{X,T) holds, that is, 

^/n{a„{X, t) — a(A, t)) — ^ A/'2(0, S) /or ?i ^ od 

one? det{T,) ^ 0. 

Then, MBB with b = o{n), but b ^ oo, for the estimator a„(A, r) is consistent, that is, 
sup |P(^/n(a„(A,r) - a(A,r)) < (x,?;)) 

- P* ( VH(a; (A, r) - iJ* (a; (A, r))) < (x, y)) I ^ 0. 
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The MBB procedure for the estimator a„(A,r) that is described above may be used 
in the problem of determining significant frequencies (i.e., the frequencies that belong 
to the set A), which, in the PC case, is equivalent to the identification of the period. 
In practical applications (see, e.g., Ycung and Gardner [28], Dehay and Leskow [8] and 
Gardner et al. [10]), one calculates the values of the estimator a„(A,r) for A € [0,27t). 
The frequencies for which spikes are obtained arc then chosen to be significant. Unfor- 
tunately, this choice is made arbitrarily, as it is not possible to construct reasonable 
confidence intervals based on the asymptotic distribution; see Dehay and Leskow [7] and 
Leskow and Synowiecki [21] for the exact form of the asymptotic variance. Therefore, 
we propose to use MBB, which provides an easy way to obtain the pointwise consistent 
confidence intervals. Certainly, it would be most desirable to conduct simultaneous in- 
ference with respect to A for a(A,T). The research of Dehay and Leskow [7] presents a 
functional CLT in r for the root statistics. However, thus far, no such result exists in the 
argument A. 

5. Simulation example 

We will use the series simulated from the PAR(l) model 



and £1,62,... are i.i.d. with the standard normal distribution. This model is PC with 
period T — Z (see Bloomficld et al. [3]) and a-mixing with a geometrically decaying 
mixing function. Figure 1 (a) depicts the series itself. Note that it is not possible to guess 
the second-order period from this plot. Figure 1(b) shows the values of the real part of 
the estimator d„(A, 1) with respect to A G [0, tt]. Since d„(27T— A, r) — d„(A, r), we do not 
have to plot the values for the interval (tt, 27t). Finally, Figure 1(c) corresponds to the 
imaginary part of the estimator. At this stage, we are unable to tell which frequencies 
are significant. We can observe several spikes, none of which seems to dominate. 
Consider the following testing problem: 



To verify Hq, wc will use T„{X, r) ~ y/n d„(A, r), which, under Hq, has zero- mean asymp- 
totic normal distribution. The quantiles of r„(A,r) are obtained by means of the MBB 
procedure, that is, we approximate the quantiles of T*{X,t) via Monte Carlo simu- 
lation. We used the block size = 30. Figure 2 depicts the values of the estimator 
a„(A, 1) (dotted lines) compared to this quantiles (rescalcd by ^/n) of orders 0.05 and 
0.95 (solid hues). The fact that the dotted lines cross the solid line means that, at 



where 




Hq: a(A,T) =0; 
Hi : a(A,T) 7^0. 
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Figure 1. Unsuccessful detection of significant frequencies for the simulated series, (a) The 
PAR(l) series, the sample size here being n = 300. (b) The values of Re(a„(A, 1)) with respect 
to < A < 7t. (c) The values of Im(on(A, 1)) with respect to < A < 7t. 



this point, we reject the hypothesis Hq. The only points at which this happens are 
A sa 2.1 « 27t/3 and A « 0. Therefore, we conclude that our series has period T = 3 
because, in this case, A,- C {0,27t/3,47t/3}. Let us add that if there were not any signif- 
icant spikes for any r, we might conclude that the series is stationary. Therefore, this 
graphical test can also be viewed as a stationarity test within the class of APC time 
series. 



6. Conclusions 



The aim of this paper was to show that the classical MBB procedure works well for 
those non-stationary time series that have periodic or almost periodic structure. For 
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Figure 2. Successful MBB-based detection of significant frequencies for the simulated series, 
(a) The values of Re(a„(A,l)) (dotted line) and MBB confidence intervals (solid lines) with 
respect to < A < tt. (b) The values of Im(a„(A, 1)) (dotted line) and MBB confidence intervals 
(solid lines) with respect to < A < tt. 
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the time series that have all joint distributions periodic, consistency holds under very 
general conditions; for the almost periodic case, we need some more stringent assumptions 
regarding moments of the series and the mixing rate. As for further research, it would be 
very desirable to estimate within these classes of models the rate of optimal block size 6, 
as well as to compare (theoretically) performance of MBB with that of the procedures 
proposed by Chan et al. [5] and Politis [23] for the case of periodic series. 



Appendix 

Lemma A.l. Let the real-valued function f be almost periodic. Assume that the set 
Af = {X€ [0, 27t) : Mt{f(t)e-'^*) ^ 0} is finite. If we have 

M,{f\t)) = M^{f{t)), 

then the function f is constant. 

Proof. Using the Fourier representation of almost periodic functions, we have that 

f{t)^ ^ a(A)e'^*. 

AGA/ 

Therefore, 

Mt{f\t))= a(A)a(27t-A). 

AG A, 



Since a{2n — A) = a(A), the assumption implies that a^(0) = X^agA kl-^)!^! so A/ = 
{0}. ' □ 

Lemma A. 2. Let (Xi,...,Ar„) be a sample from the time series {Xt'.t £ Z} that is 
strictly periodic with period T . Then, the triangular array {i^n,* '-t = l,...,n — & + 1}, 
where Yn.t = Xt + ■ ■ ■ + Xt+b-i, is row-wise strictly periodic with the same period T for 
any sequence of positive integers b = b{n) < n. 

Proof. Since, for any ?- e N, t,Ti, . . . , r^-i G Z, 

iXt,Xt+i, . . . , Xt+b-i,Xt^T-^ , Xf+Ti+i, ■ ■ ■ : A'f+n+b-i, 

■ • • , Xt+rr-i 7 Xt+r^-i+l^ ■ ■ ■ :Xt+Tr-i+b-l) 

= (Xt+T, ■ ■ . ,Xt+T+b-l,Xt+Ti+T, • • ■ , Xt+Ti+T+b-1, 
■ ■ ■ iXt+rr-i+T, ■ ■ ■ , Art+r^_i+T+6-l), 

calculating the values of these vectors under the Borel measurable mapping that sums b 
successive elements of an r&-dimensional vector, we obtain 
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Lemma A. 3. // the time series {Xt : t £ Z} is strictly periodic ( or SP (r)) with period T 

and the Junction /:M > M is Borel measurable, then the time series {/(X():igZ} is 

also strictly periodic (or (r)) with the same period T. 

Proof. For any r e N, define the function g : W — > W as 

g{xi,...,Xr) = {f{xi),...J{Xr)). 

Knowing that for any i, ri, . . . , r,,-! G Z, 

calculating the values of these vectors under the measurable mapping g, we obtain 



{!{Xt)J{Xt+r,), . . . , f{Xt+r^_,)) ^ {f{Xt+T),f(Xt+r,+T), / , +t) ) • 



□ 



Lemma A. 4. Let {Xn^t-t — l,...,d„}, where d„ oo, be a triangular array of real 
random variables, which is row-wise SP(1) with the same period T. Assume that: 

(i) for t= l,...,r, the series {^n,t}^^„j cire uniformly integrable (we denote by 
Xn,nt ihe first element in column t of the array {Xn^t\ ); 

(ii) the following limits exist and are finite 

fii = lim EXn,i, 

n — 'OO 

fl2 = hm EXn,2, 
n — *oo 

= lim EXn,T; 

n — 'OO 

(iii) there exists a triangular array of non-negative real numbers {a„_7- : r = 0, . . . , (i„ — 
1} such that 



d„-l 

dn 



-r On r ^ for n — > (X3 



T=0 

and, for every ACzM, t = 1, . . . ,T and r = 0, 1, . . . , — 
We then have 



— Y^Xn^t-^l^, 



t=i 
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Proof. The technique to be used here is a modification of the proof of Lemma 1 from 
Radulovic [25]. Let Yn^t ~ Xn,t — EXn,t- Due to the periodicity of EXn,t, it suffices to 
prove that 

-I <i„ 



Letting Yn t = ^n,tl|y„ i|<A„ and Yn,t = 5^n.tl|y„ t|>A„j the above convergence foUows 
from 



1 ^ 

-^J2^Y,,,t-EY„^t)^0 



(7) 



and 



— Y,(Xn,t-EY^^t)^0. 



(8) 



To prove (7), note that, for any e > 0, 



P 



^ t=l r=0 



- 7^ E E ^«an,r 
t=l r=0 



Letting 



it is easy to see that An oo and we therefore obtain that 



•(|;^|:(?--^?")|>')4(5;g°- 



1/2 



•0 for 
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In order to prove (8), note that, by Lemma A. 3 with the function f{x) = a;l|2:|>yi, we 
have, for any e > 0, 



P 



1 



-l-Y.O'n,t-EYn,t) 



J2iYn,t-EYn,t) 



< 



t=l 



2(K/rj + i) ^ 



By uniform intcgrabihty of the sequences {Xn,t]^=nt ^ = we obtain the 

desired convergence to zero. □ 



Lemma A. 5. Let [Xi^ . . . ,Xn) be a sample from the time series {Xt'.t ^ Z} that is 
WAP(l). Assume that 

(i) the set A = {A : Mt{EXte-'^*) ^ 0} ts finite; 

(ii) there exists a finite constant K that does not depend on b = b{n) < n and n, such 



that 



( 1 \* 
sup E\—y^ {Xt - EXt) < K. 

.,n-b+l \Vb J 



There then exists a finite constant K' that does not depend on b and n, such that 



sup 

s— l,...,n— 6+ 



/ .+6-1 \4 



where fi = Mt {EXt 
Proof. We have 

s+b-l 



s+b-1 



s+b-l 



E 



Vb 



Vb 



E 



( 1 \' 



s+b-l 



s+b-l 



V6 
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, 2 



s+b-l 



Vb 



t=s 
s+b-l 



' -. s+b-l \4 



Due to (1), we have 



s+b-l , 

771 E(^^*-M) = obf 



V6 



Therefore, 



The first term is uniformly bounded, by assumption (ii). For the second and third terms, 
we have 



E 



/ -I s+b-l 



EXt 



s+b-l 



4\ 1/2 



< 



and 



s+6-1 



4\ 1/2 



< 



< 



' / s+b-l \ 4^ 3/4 
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Lemma A. 6 (Lcskow and Synowiecki [21]). Let {Xi, . . . , X„) be a sample from the time 
series {Xt : t S Z} that is real-valued and APC. Assume that the autocovariance function 
is uniformly summahle, that is, there exists a summable sequence {Cr}^o ''^'^^ num- 
bers such that I Cov(Xt, Xt_|_T-)| < Cr- There then exists a number a"^ such that, for any 
sequence b = b{n) < n tending to infinity, 



sup 

=l,...,n-b+l 



Var 



for n - 



Proof. We refer the reader to Leskow and Synowiecki [21]. □ 

Proof of Theorem 3.1. The following proof develops the techniques presented in 
Radulovic [25] and Gine [11]. We can assume, without loss of generality, that /-f = 0; 
note that this does not mean that EXt = 0. For each n £ N and t = 1, . . . ,n — b + 1 
(recall that b — b{n)), we let Zt.b ~ Xt + ■ ■ ■ + Xt+b-i- The random variables Z*^ are 
conditionally independent (given the sample) with common distribution 

P*(Z,% = Zt,b) = 1— for i = 1, . . . - 6 + 1. 

By Corollary 2.4.8 on page 63 of Araujo and Gine [1], the conclusion of the theorem is 
implied by the fact that for any (5 > 0, 

iip\-y^i^\>^)^'^^ (9) 

E^^*(4^;,<-l|^;j<v^.) -il^E*{Z,,,)J^Q (10) 

and 

EVar*(^-Lz;,,l|^.^l<^,) -^a\ (11) 

where I5 denotes the indicator function of the statement S. 
In order to prove (9), observe that 

/ -. \ -, n — b+l 

j=i ^ V ^ t=i 
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Let 



and consider the array {Un.t-t= l,...,n— b + 1}. By Lemmas A. 2 and A. 3 with 
f{x) = we obtain that this array is row-wise strictly periodic. In order to 

show that {U„^t} satisfies the assumptions of Lemma A. 4, define the triangular array 
{Vn^t-t = l,...,n-b+l} as 



Vn.t = tZ^ 



Observe that for any fixed t = 1, . . . ,T, 



^b + t-i V6 VI ^-^^^'"^ 



and 



Since /i = 0, the convergence E'^{{l/^/b)Zt.b) ^ is implied by the inequality (1), whereas 
the convergence \ai{{l/ \/b)Ztfi) results from Lemma A. 6. Therefore, the sequences 

are uniformly intcgrablc. Moreover, since Z^^^ > nS^ for Un.t 7^ 0, we obtain the estimation 

Zh 1 

which implies that the sequences 

are also uniformly integrable. Next, due to uniform integrability of {V^^i}, 

0<E\U^,t\=Eikl^z,^,l>^5) 
Zh. \ 1 



so EUn,t — * for n — > oo and fixed t = 1, . . . , T. It is easy to see that the triangular array 
{Un,t} is row-wise a-mixing with au^^{T) = ax(max{T — b{n) + 1,0}), where ax is the 
mixing function of the underlying scries {A't}. By the inequality 

Cov{Un,t'i-\U„,t\<A,Un,t+T'i-\U„,t+A<A) ^ ^^^(^uSt) 
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(Lemma A. 0.2 from Politis et al. [24]) and the estimation 

_^ n—h ^ ^ n—b 

TTtXI^'^-W- r~T + TTtXI^^^^)^'^ forn^oo, 

n — 0+1 ^-^ n — b + 1 n — 0+1 ^-^ 

r— r— 

we obtain that condition (iii) of Lemma A. 4 is satisfied with a„_T = 4af/^ (r). 
In order to prove (10), observe that 



-j^ n— b+l 



denote 



and consider the array \U'^ j : i = 1, . . . , 7i — + 1}. By Lemmas A. 2 and A. 3 with /(x) = 
(k I \fn)x\\x\-^C ^ have that this array is row-wise strictly periodic. Moreover, since 
4,>n52for[/;,^0, 



so we have that the sequences 



< \K,\ = k—\Z,Ahz,.\>^.s < k-^zl - ^-f = ^K,, 



/ T oo 

n— riT 



n—ni 1 • ■ • 1 {K,t} 

are uniformly integrable. Since 



i?[7^ ( — * for ri ^ oo and fixed t — 1, . . . , T. By the same considerations as at the end 
of the proof of (9), we can apply Lemma A. 4 to the array {U'„ f} to obtain that (10) is 
satisfied. 

In order to prove (11), observe that 

(12) 

^ n-b+l ^ / ^ n-b+1 ^ \ 2 

^n-b+1 ^ lZlbhz.M<V^^s- E ^^^tAiz,M<V^^sj • 
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We will treat the terms separately. For the first, we have 

ji-6+l 



1 V- 1 2 

t=i 

n-b+1 ^ b^''" n-b+1 ^ b^lbhz.M>V^s 

n-b+l ^ ^"'*~n-fe+l ^ 



t=i t=i 



where 



{K,t ■■t^l,...,n-b+l} = I ,|>yjr5 ■■t = l,. 



,n-b+l 



We have shown uniform integrability of the sequences 

and that for any fixed t = 1, . . . ,T, EVn.t — * cr^- Due to this, and the fact that 

we also have the convergence EVJ^ ^ — > for fixed t and n ^ oo. By Lemma A. 4 applied 
to triangular arrays {V^,t} and {^4}, we obtain that the first term of the right-hand 
side of (12) tends in probability to cr^. For the second term, we have 



t=i 

n-6+1 n-6+1 



t=i " j=i 

Consider the arrays 

{Tn,t ■.t^l,...,n-b+l} = \^Zt^b:t = l,...,n-b+l 



Vb 



and 



{Tit : i 1, . . . ,71 - + 1} = l^-^Zt,bl\z,,,\>^iS ■■t = l,...,n-b+l 



Since it is assumed that /i = and that inequality (1) holds, we have 
1 

Vb 



E{Tn,t) = ^{Xt + --- + Xt+b-i)=o(^^^^0 forrwoo. 
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By the Cauchy-Schwarz inequality, the sequences 

trp TOO frp TOO 

\-Ln,lfn=ni ' ' ■ ' ' I-'- n.T f n=nT ' 

fn^' \oo /T^' \^ 

t-^ n,l Jn=ni J ■ • ■ J t-' n,TJ'n=nT 

are uniformly integrable. Applying Lemma A. 4, we obtain that 

This completes the proof of (11). □ 
Proof of Corollary 3.1. Wc can write that 

[n/T\ [T\ 

+ j;{X(in/Tl-l)T+l H \-Xln/T\T) \ +Op(l), 



where 



ln/T\T 

ttn = > 1 lor n ^ oo. 



It is easy to see that the time series Yt = {Xtr+i H |-X(t+i)T)/?' is strictly stationary. 

Therefore, we may apply conditions for the CLT for the sample mean of strictly station- 
ary sequences (Ibragimov and Linnik [16]) to sec that under assumptions (i) and (ii), 
asymptotic normality holds. Now, note that, due to periodicity, wc have 

sup E\Xtf+^ ^Ah+s <oo 

tGZ 

and, by Lemma A. 0.1 from Politis et al. [24], 

oo oo 

^ I Cov(X„X,^.)l < 8<?+^-^ E^x^^"-" W < 

T=0 T=0 

By Theorem 3.1, the proof is completed. □ 

Proof of Theorem 3.2. Using the same steps as in the proof of Theorem 3.1, wc must 
show the following laws of large numbers: 
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n-b+l 



t=i 
t=l 

n-b+1 

-6+1 ^ 

^ n-b+l 
n-b+l 

"6+1 ^ 



where all of the arrays were defined in the proof of Theorem 3.1. Take {Yn.t :t=l,...,n — 
6+1} to be any of these arrays. Due to the mixing condition of the underlying series 
{Xt}, we have the estimation 

Cov{Yn^t'i-\Y„,t\<A, Yn,t+T'i-\Y„,t+T\<A) < ^0,n,T 

for t=l,2,...,r = 0, l,...,n — 6+1 — t and 



^ n—h 



n—b 

■0 for 

T = 



We must show that 

d 



where L is 0,^ or cr^ + /i^, depending on the array, and. in the sequel of the proof, 
without loss of generality, we assume that /i = 0. Letting Yn^t ~ Yn^t^iY^ t|<A„ ^-nd Yn^t = 
5^n,tl|y„ t\>A„j the above convergence follows from 

— Y.iYn.t - EYn,t) ^ 0, (13) 



t=i 



1 _ _ 

-^Y.^Y„,t-EY„,t)^0 (14) 



t=i 
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(15) 



Taking An as in the proof of Lemma A. 4. condition (14) is satisfied due to the same 
considerations as in the proof of (7). Therefore, it suffices to show that conditions (14) 
and (15) hold. 

We have that, for any e > 0, 



\ ^" t=i 



>e] <-^E 



Y,{Yn,t-EYn,t) 



t=i 



t=i 



In the foUowing, we wiU carefuUy use the Cauchy-Schwarz and Chebyshev inequalities. 
For the array {Un,t}, we have 



n-b+l 



< 



1 


n-b-\ 


- 1 


1 




n-b-\ 


- 1 


1 





n-b+l 

E - 

t=i 

n-b+l 

E ' 

t=i 

n-6+l 



)— E ^ 

6+1 ^ 



tM 



2J4 



For the array {U'^t}, we have 

n-b+l 



^ It— 0-1-1 ^ n—b+l / ^ \ 
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For the array {Ki,t}, we have 

n-6+l 

bTi ^ ^^"^-"^ 



n-6+l n-b+1 
\V„,t\>A„ 



t=l t=l 



1 


71 - feH 


- 1 


1 




n-b-\ 


- 1 


1 





t=l 



< 



For the array {1^^ ^j, wc have 
For the array {T„_t}, we have 

n—b+l ^ n— 6+1 ^ n 
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For the array {T^^j}, we have 



t=l 

n-6+1 



t=l 

n-b+l 



< 



Applying assumption (iii), Lemma A. 5 and the fact that both fc — > oo and A„ oo, we 
obtain that condition (14) is satisfied for aU of the arrays. As for condition (15), from 
the above, we immediately obtain that for n oo, 



n-h+l 



1 :o ^ , ^ 

-6 + 1 ^ 

t=i 

^ n-b+l 

t=i 

^ ji-6+1 

t=i 

n-&+l 

-6 + 1 ^ 



Moreover, 



t=l t=l 
which follows from inequality (1). As for the remaining array {14i,t}, we have 



t=i t=i 

1 "-''+1 r / 1 \ 

1 



^(i;Xt + ... + sXt+,_i)^ 



Moving block bootstrap for (almost) periodic time series 



1177 



which is impHed by Lemma A. 6 and inequahty (1). This remark completes the proof of 
Theorem 3.2. □ 

Proof of Corollaries 3.2 and 3.3. We use Theorem 3.2. By the same reasoning as 
in the proof of Corollary 3.1, we obtain that the autocovariancc function is uniformly 
summable. Assumption (iii) of Theorem 3.2 is implied by Theorem 5 from Kim [17] for 
Corollary 3.2 and by the reasoning of Annexe C from Rio [26] for Corollary 3.3. □ 

Proof of Theorem 4.1. This is straightforwardly implied by the Cramer- Wold device, 
Corollary 3.2 and Remark 4.1. We simply note than any linear combination of the real and 
imaginary parts of the series {Wt(A, r)} also satisfies the assumptions of Corollary 3.2. □ 
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